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ABSTRACT - ' . • 

This Personalized Activity Kix deals with one aspect 

cf preparation for group process, that of orienting* members and 
obtaining consensus on basic issues prior to convening the group. The 
participants will learn the delphi technique and use it m a , 
hypothetical situation. The delphi technique can .facilitate the 
wotjting of a group , by familiarizing group memi)ers . with the expressed 
views of other members and by resolving certain basic issues or 
questions prior to the actual meeting of the grpup. Activities, 
exfercis^^s, and facilitator guidelines , are included in appendixes, 
(Author/IRT) \ - 
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* sUDDlied bv EDRS are the best that can be made frqm the original- * 



A SCHOOL IMPROVEMENT - ACCOUNTABILITY PROCESS KIT 

PAK #1.^ - OSING TWE DELPHI" TECHNIQUE TO J?EACH "AGREEMENT 



l'!.MM:MAit ifj |r;. Mr f it •; i- I JmI''. r(.)>''Y 



QUi«t^ *tMMi<<::.;< 



,'.ilM rul NAIlONAl, IN 
THb" uOPYf41<.\Hr. 



^^^^^ 



us DEPARTMENT OF HEALTH, 
EOUCATtON & WELPAKE 
(. NATIONAL tNSTiTUTE OF 
EOUCATtON 

THIS DOCUMENT HAS BEEN REPRO- 
DUCED EXACTLY AS RECEIVED FROM 
Th(: person or ORGANI/ATlON ORtGtN* 
AtiNO IT POIN TS OF VJEW OH OPtNIONS 
STATED DO NOT NECESSARILY REPRE- 
SENT OFFICIAL NATIONAL INSTITUTE OF 
EDUCATION POSITION OR POLICY 




, SCHOOL IMPROVEI^ENT/I*^ 



ACCOUNTABILITY 
PROCESS 



<»/ ^.eT 



PROGRAM 
Development & Modification 




03' 
O 



Personalized Activity Kit (PAK) for use as:- 

° = - Individualized Study Guide 

- Small Group ^i^jjdy Guide. 

- Workshop FaEf||:|ta tor's Guide 

COLORADODEPARTMENT OF EDUCATION . 
Calvin M. Frazier, Commissioner of Education - 



COLORADO DEPARTMENT OF EDUCATION 



Mrs. Robin Johnston, Chairman^. . . • ?. • • Denver 

(First Congress^ional District)' " . 

Lewis; E. Stieghorst, 'Vice-chairman . . .... . . . . Littleton 

(Second Congressional District)' , 

Bill Graham Beulah . 

(Third Cpngressibnal District) . 

Alle'n B. Lamb ......... Windsor 

(Fourth Congressional ^District) 

Mrs. Betty Fevlbert . . . Aurora 

(Fifth Congressional District) r 



e 

t ■ ■ ^ 

#789, 200CC 
May 1976 



J- 



A SCHOOL IMPROVEMENT - ACCOUNTABILITY PROCESS KIT 

■ • . * 

PAK #1.4 - USING THE DELPHI TECHNfQUE TO REACH AGREEMENT 



ACCREDITATION AND ACCOUNTABILITY SERVICES UNIT 



Eugene R. Howard, Director 



OFFICE OF FIELD SERVICES. 
Stanley" A. Leftwich, Assistant Cormissioner 



COLORAD9 DEPARTMENT OF EDUCATION 



Calvin M. Frazier 
Commissioner 



Denver, Colorado- 
. May . 1 976 



4 



This PAK was written in 1973 by members of the District 
Planning, and Accountability Services Unj[t. 



Leonard P. Landry, Director . • . 
Joan-Harrigan 

Edwin Hildebrand \ 
. Rachel Rassop , 
. Jerry Villars 



Jefferson N. Eastmond, Consultant 



Second Prin'ting May 1976 



' ^ x ■ ■ * ■ • ■ 

Copyright © 1973 by the Colorado Department of Education-. 
All rights reserved. No part of this document may be reproduced 
In any form without permiss ion in writing from the Colorado De- 
partment of Education, except that Colorado public school personnel 
may reproduce all or any portion of this document for use in their 
respective school districts and Boards of Gooperative Services. 



DIRECTIONS FOR THE USE OF THE PAK . ^ 



Each PAK is designed to be used in three alternative ways: 1) an in- 
dividual user can work through the packet on his .own; 2) a small group 
may work cooperatively; oV, 3) a group -of participants may be involved 
in a jrforkshop situation under the Teadership of a facilitator. Exper- 
. ience indicates that the latter is the most desirable situation. While 
an individual may work through the materials on his own, tie misses those 
shared learnings which come as learners .interact in a group situation. 



PLEASE NOTE 

^ ' « , • 

B^caase this PAK will bemused by many people in 
your districtj, please mark only the worksheets 
supplied by your instructor. Do^ not marl: the ^ 
page^ 'of_ this PAK. Sample transparencies and 
V wd^ksiheets (for duplication) are ipcluded in 

Appendices A^and B. 



If you are using PAK materials in a group workshop Situation, consu4^ 
Appendix A for ^detailed instructions. 'The diagram on the cover page %nd 
diagrams for Appendix A may be used to make overhead transparencies. 

If you are wpH<ing through the PAK. individually , follow the general 
directions listed below: . ^ " . 

^ Read content of the PAK. 

- Refer to Appendix A, page 2^ for additional instructions. 
^- Bo the "exercises on worksheets fopied from Appendix B. 
. Read thf^ bibliography (when included). . .^ 



PAK ^1.4 



THE DELPHI TECHNIQUE 



Purpose ' 

This PAK deals with one aspect oi^reparation for group process/ that of 
pre-orientation and obtaining consensus on basic issues prior to conven- 
ing a group. The participants will Jearn the Delphi Technique and use 
it in a hypothetical situation. / 

Prior to Convening a Group ^. 

Group process is 'often an excellent method for examining various issues, 
making decisions and solving problems. However, large amounts of time . 
can be wasted unless prior planning helps the group to spend its time 
effectively. 'Using the average amount of time* spent by the participants 
multiplied by the number of participants provides an estimate of the num- 
ber of man-hours or man-days involved in group worR. For example, if 
five participants are involved in one eight-hour conference, the time 
spent is the equivalent of forty man-hours or. roughly the'work of one 
person for one week's time. The point is simpTy that all possible pre- 
liminary preparations should be made prior to a\group meeting to facili- 
■tate the working of the group. One such preparati'on involves the use of 
the Delphi Technique. . 

The Delphi Technique collects opinions from a number of persons in 
scattered locations without bringing a formal group together. The Delphi 
Technique is suggested not as an alternative to group process, but as a 
supplement to be considered for making certain basic decisions prior to 
convening a group. The basic plan for use of the technique is shown in. 
the diagram ,on the following page. For stepS #2 and #4, one person must 
■ take responsibility and may need clerical assistance . 



FIGURE 1: DIAGRAM OF DELPHI TECHNiqUE 
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Step 'l . 

Ask members to write out'and mail in their individual reactions'to a 
question or objective. -^Questions^ should provide for opei;^-ended response 
which allows- theoparticipant to react to the question in some depth. 
The number of questions should be limited (no more than 3 - 5) to avoid 
becoming too time-consuming. To be manageable, one should limit the'^ 
'number of persons participating. More than forty people makes step 2 
very time-consuming and difficult. 

Step 2 . ' ' ■' ' 

Responses are suitmarized- and the results returned by mail to each. parti- 
cipant. Original responses ar6 also returned. Whenever possible it is 
useful to combine statements in a form that indicates the numqer of simi- 
lar opinions. For .example, "threelof the five members^ cited programmed 
learning as an ^antfcipated trend irt edycatfon". It is possible to ex- „ 
pand on opini*ons expressed and' to qWte portions of the responses given. 
In particular, elements of consensus are emphasized. . ♦ 

step 3 . ■ ' \ , 

Individuals read the summaf-y statement. Each member is then asked, to re- 
examine hfs original position and make any chang& he feels arff necessary 
in light of others' opinions. \ 

Step 4 . •.. . , 

« . • .» 

Results are ^umnarized and tabulated with cbnments .from the piembers. 
Particular elements of consensus are noted, as are areas where , further 
explanation or discussion is needed. Steps .1-4 may be repeated sev- . 
eraT times. It is time to stop the cy?le when it becomes. obvious, that 
the group is no longer moving toward increased agreement^. — 

Step 5 . ^ . • ^ . . 

The group is convened for interaction* with others involved. Certain areas 
of consertsus have been identified. Certain opposing points of view may 
have been modified or at least clarified. The meeting agenda can now be 
built-around resolution of majorJ'pcoblems where consensus has not beerf. ^ 
reached. h 

For maximum" effectiveness, adequate time must be allowedLpripr .to con- 
vening the group. For- a group located in different offices'in a single 
building, it is conceivable that steps 1- 4 could be accomplished in 
less than a week. Where the material jnust travel , by mail, a month-J6r 
more may be necessary. 

A number of uses for this techniqi^e have been (devised. At times, it may 
be impossibl-e to call a group together, and the Delphi Technique repre- 
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sents. one method o.f reaching consensus among thos# concerned. , Other pos- 
• slble uses are: dep1ct1>ig t|ie futu>e;; Identifying possible areas of con- 
cern; and de^crlb'lng posslb^e'solutlons.. In any case the technique relies 
upon prompt and careful responses from the participants 
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PAK. #1 .4 EXERCISES 



M , — 



Djrectipl^' fir Participant Working Alone 

.'TQrh ta Appendix A and .read through the -facilitator's guide. Look. at 
"the diac^jajjis. * . ^ ' ^ 

Nextl, scan the' exwcise' sheets in Appendix B. ' 

Now^Q. bacl^.lo the guide'^ and work thro^ugh the exercises. Please do not 
.wri.te on the exercise sheets in tfijs PAK.. 

' .«? • • 

airect^ns 'f-or. Participants' Working in Groups 

7^ ~ V ■ \ . • . ^ 

■Turn to 'Appendi)( A. Mi.*-f'ollovrth6, directions. Get extra exercise sheets 

from yo6;5faeilitat;^">. ' ^V A.,., 'v 
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SUMMARY - PAK #1.4 

The Delphi Technique is recommehded to facilitate the workings of a group 
through (1) a familiarization of group members with the expressed views 
of other members, and (2) the resolution of certain basic jssues or 
questions prior to the actual convening of the group. Specifically, the 
following considerations were anphasizetl: 

1 . The need for maximum effective use ot the 
time of persons, in a group effort. \^ 

" - . \ 2. The rationale for pre-conference work tbx 

facilitate group process. 

. 3. There are three-genera Vphases-of- the 

Delphi Technique: . responding, to a 
questioKpaire; summarizing thef input- > 
' Lfrom^eath participant; and, building ^,^1 
' ''.an' agenda.: , -^^ ,. • . - ■ 
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. ^ . . APPENDIX A » \ ■ \ o- 

FACILITATOR'S GUIDE FOR GROUPS * 

"Each PAK has been organized around a fundamental and widely recognized 
generalization of how people learn. Learning occurs more efficiently 
wh'en an overview is presented first. Succeeding learning experiences . ,„ 
Aten take the person deeper into each concept adding more spefcific de- 
y^M. There may be several leve^"'^'"^€j^sure.unti^ real expertise, i>., 
developed. . " ~ 



Workshop Specifications 

I, Time. Required : :__„_l_Jwo , — L:.- zz: : — 

II • Facilities: ' ^'oo"' "^^^ each 24 participants. 

' Participants to be seated at 

tabli^s.(maximuni of six per table). 
Rooms should provide adequate 
' accoustics and physical comfort ^ 

* suitable for a workshop session; 

Ilf. Equipment & ^ . . j - 

Material Needs: One overhead projector and viewing 

screen per room . 

\- ' ' ' 

Power .extension cord (1. per room) 
Transparency, sheets ' 
^ Grease pencils 

4 , ... .^^ . ;^ Butcher paper , 

— V Masking tape 

• ' \^ • Chalkboard, chalk, eraser 

<^ :. Name tags (if necessary}. 



Workshop Activities for PAK #1.4 



1? 



5. 


15 jn1n. 


6, 


5 min. 


7- 


^10 min. 


8. 


5 min. 


9. 


10 min.. 


10. 


Ip min. 







The following sequence of activities is suggested and may be modified at 
your discretion, , ■ 

1. 10 min. Have participants read the PAK materials beginning 

on page li and ending with page headed "Exercises." , 
Share questions and reactions. 

2: 15 min. , Divide into smatll groups. . Designate a leader and a 

:, recorder for each group. Ask each participant to 
^ " complete, Exercisei #1. working alone. Do not* discus^ 

exercise at tliis poiiit. . 

3' 10 min. Hand in Exercise #1- to group leaders and take a 10 _ 

:_minu±elbreaJc Durjng-the-break,-gpoup -leaders -should 

.compile and sunmarize notes for usie on the chalkboard 
of newsprint. "Make notes in a format similar to 
' . Exercise .Sheet #1. The recorder should. fiTl out . 

. Worksheet #2. - ^ V; 

4 30 min. Following the break, participants meet in smV; r - ->ups 

to discuss the problem in light of their dompiU. re- 
sponses. Point out that this exercise leaves out 
^ steps 3 and 4of the Delphi Technique. Emphasize 
that for actual .use of the Delphi Techni'que, these- 
steps are recojtinended/ Have the participant; com- 

. ' pTete, Worksheet #3 as a group. 

Have the recorder, report his group's answers to the 
total group. • " • 

In small groups, brainstorm a list of possible uses 
of- this Technique in other situations. - ^ 

Have recorders report to total group . 

In small groups, brainstorm ways to improve the pre- 
orientation process. 

Have recorders report to. total group. 

Call attention to the Summary. Remind participants 
complete the PAK critique form and turji it in. 



. . . NOTE: As quiakly 'as poeBihley revvea the qriH 

forma for feedbcusk infdrmatum that may be 

. i,. helpful during other workBhope. . 

Total Time; ApproXima'tely 2 -hours . - 
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FIGURE 1: . ; 
DIAGRAM. OF THE.DELPHI .TECHNIQUE' 



_ASK, MEMBERS OF A G«OUP TO 
SUBMIT THBIR REACTIONS TO A 
QUESTION AND CONCERNS i . 



. TRESPONSES" ARE SUMMARIZED. 
RESULTS ARE RETURNED WITH 



■ORIGINAL RESPONSES. 5 



INDIVIDUAL MEMBERS READ 
THE SUMMARY AND. CHANGE . 
ANY ORIGINAL. RESPONSE BASED 
ON others' OPINIONS. 



\ 



RESULTS ARE "SUMMARIZED AND 
TABULATED WITH/COMMENtS, 



GROUP IS CONVENED FOR 
- 1 NTERAeTTpN-tD F-TDFAST 
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PROCESSING FEEDBACK FROM, 
„ ^ PARTICIPANTS 



1. LOOK FOR AREAS OF CONSENSUS 0;R GENERAL AGREEMENT. 
A WELL-PREPARED QUESTIoNNM RE HELPSi^^ 



2. TABULATE THE NUiltR OF ANSWERS TOlR'#K^^^ 



-A GIVEN. QUESTION. 



; - 



-AH, 



3.. ... WRITE DOWN COMMENTS THAT ADD INSIGHT TOWARD ; 
RESOLVING THE QUESTION/. EITHER "FOR" OR "AGAINST/ 



A- 5 
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PAK #1.4 Exercise #1 



Dear 



I ayn attempting to assess the ideas and feelings of a number of people 
concerning the principal's rple in' settling disputes or controversies 
among staff members. Please indicate your opinion regarding eacli of 
the fol Towing: 

• * ■ • > . . . • . ■ ■ ■ <j - • ■ " • _ ■ . . ■ 

. -1.- Do you feel that tbe principal has an -obligation to ' ^ 
. settle disagreements among staff members? 



23 Which of the fol lowing areas 4° believe a school 
\ priricipal should be or should not be involved in* resolving? 



a. Pblicy questions 

b. Ethical cons^iderations: 

■ 

c. Scheduljhg or 
class Ibad 



d. Personality conflicts 

K . ■ 



Thank you for your response. Responses will be compiled and returned 
Tor ypur^reaction aj[)d< comments in the near fi/ture. ^ 



Sincerely, 



.. Appendix B / 
PAK #U4. Exercise.#2. 



The purpose/^f this exercise is to prepare you to handle the data 
generated--by the Delphi Technique^ phase 1. 

From the returned questionnairesy answer the following questions: 

1. There js/is not divergence of opinion as to whether the principal 
has an^bligafeion to settle disputes or controversies among staxff 
; mem&efsT ~— ^--^ , . 



Number affirmative 



Number neigative 



Cornments riiade (summarized) 



1. 

2. 

3. 
4. 
.5. 



FoXeach of the areas- in question,,. eite the number in favor of a 
pripcl^rs involvement, ali^ the number opposed. Include partici 
:pant co^ents where appropriate. 



-Number-affirmative 




Number negative 



Ethical consid^ation: Number affirmative^ . Number negative 



PAK#1.4 



4,. , , ■■ 

5i _ • 

Scheduling, 
or class, load 

t' . ■ • 
2. 

4. 
5. 

Persojiality 
conf 1 4 cVs 

2. 

;3. ' 

.« »■ V » 

4. • 

5,. 



Number affinnative 



Number negative 

■ . # * ■ — " 



Number, a f f i' rma t i v e 



Number negative 
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PAK #1.4 Exercise #3 • 
To be completed prior to group discussion. \ / ' 

. . ■ ^ ■ . ...... ' ■ ..v.- 

1. In view of the ideas, expressed by others in the group, which of your 
^ original opinions would you change or revise at this point? 



a. 
b. 
c. 



2. 



It should be evident from the tabulation which points have general 
-ag^erpjent and whi^ 

a. Note^ppaois^of agreement among the group. . 

b. Note points. of dfsagreement. . 



Now the group should meet together and discuss the building of an Agenda 
to* discuss the question. Points of agreement can be covered, quickly and 
points of disagreement will take more time for clarification. ; 

1^. In vyhat order would your gVoup deal with che topics? 



a. 
c. 



2. Are there some topics which need not be discussed at all?/ Which- ones? 
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PAK '# * 
,(Pleas€^m in #) 



PAK CRITIQUE FORM 
Please give your assessment and corments on the ^following: 



t' 

PROGRAM ELEMENT 


'OUT- 
STANDING 

'J 


VERY 
GOOD 


FAIR 


"POOR 


VERY 
POOR . 


COMMENTS 


• • • •• 

1. The . quality & rele- 
vance 6f the subject 
matter. 














2. The appropriateness 
.and usefulness of a ; 
' the instructional ' 
materials.' 












• 


3/ The timing or se- . 
.quencing of the 
various items pre- . 
sented. 


- 

» 




*> ' 








4/ The directing and 
assistance given 
' on the exercise. 















"" Other comments oriu-suggestions for improving this PAK: 



/Pf thisl PAK uas used as part of . a WORKSHOP training session^ then please also 
complete the follaiHng: \ . , 



> 

The -deployment, 
: — grouping or. 

planned iriteraction 
/ of the participants. 




> 






9 

.1 




, _ — z — " 

The productivity ancf/ 
or usefulness of the 
individual .work 
session (s ) . \ 




* 








■J 


1 . The comments or assis- 
tance given to you on 
^our selected p'rtibl em. 















